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SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

Be it known that We, Jose Luis Moctezuma de la Barrera, a citizen of the Germany and 
Mexico residing at Vordere Poche 1 1 , 79 1 04 Freiburg, Germany and Dr. Ing. Harald Hoppe, a 
citizen of Germany, residing at Wiesenweg 2, 77855 Achern, Germany has invented a new and 
useful ENHANCED ILLUMINATION DEVICE AND METHOD of which the following is a 
specification. 
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TITLE 

ENHANCED ILLUMINATION DEVICE AND METHOD 

CROSS REFERENCE TO RELATED APPLICATIONS 
[0001] Not applicable 

REFERENCE REGARDING FEDERALLY SPONSORED RESEARCH OR 

DEVELOPMENT 

[0002] Not applicable 

SEQUENTIAL LISTING 

[0003] Not applicable 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0004] This invention relates to enhanced illumination devices and more particularly to 
operating room lighting systems and methods that additionally project data to assist the 
surgical team. 

2. Description of the Background of the Invention 

[0005] Proper illumination of a surgical site is very important to a successful surgical 
outcome. As such, the operating room light is typically position to provide high quality 
lighting without shadows to the surgical site. Operating room lights are mounted so that they 
can be positioned to provide good line of sight lighting to the operating field. Because of the 
favored position of the operating room light, there have been proposals to incorporate other 
systems used during surgery that rely on or require good line of sight into or attached to the 
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operating room light. For instance, U. S. Patent Publication No. 2003/0164953 discloses 
attaching a tracking camera system to an operating room light. 

[0006] In addition, it is desirable to provide enhanced augmented reality data to a field of 
interest, preferably to a surgical field. The incorporation of augmented reality into a surgical 
operating room lighting system will enable the surgical team to concentrate on the surgical 
site without the need to look away to an external display device to monitor the patient's data, 
to review information, or to use surgical navigation systems. There have been proposals to 
project data onto a surgical site however none of these proposals suggest using light from the 
operating room or a similar light source to project the data onto the patient. 



SUMMARY OF THE INVENTION 

[0007] One aspect of the present invention comprises a light source to illuminate a field 
of interest that includes an illumination module capable of projecting illumination light to the 
field of interest and a light projector associated with the illumination module. The light 
source also includes an input device associated with the light projector; the input device 
capable of sending signals to the light projector such that the light projector simultaneously 
projects data light along with the illumination light to the field of interest. 

[0008] An additional aspect of the present invention comprises a method of providing 
light to a field of interest that comprises the steps of projecting illumination light from an 
illumination module; projecting data from a light projection module associated with the 
illumination module; and capturing surface data from within the field of interest. 

[0009] A still further aspect of the present invention includes a light source to illuminate 
a field of interest that comprises an illumination module comprising a series of digital light 
projectors capable of projecting illumination light to the field of interest. Also, the light 
source includes an input device associated with the illumination module; the input device 
capable of sending signals to the illumination module such that the illumination module 
simultaneously projects data light along with the illumination light to the field of interest. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] FIG. 1 is a schematic view of one embodiment of the present invention; 

[001 1] FIG. 2 is a schematic view of a second embodiment of the present invention; * 

[0012] FIG. 3 is a flow diagram of one embodiment of the method of the present 
invention; 

[0013] FIG. 4 is a schematic view of a surgical field showing the projection of data onto 
the field; 

[0014] FIG. 5 is a schematic view of a third embodiment of the present invention; 

[0015] FIGS. 6a-e are a schematic representation of one embodiment of data light of the 
present invention 

[0016] FIGS 7a-e are a series of representations of the embodiment of FIGS. 6a-e; 

[0017] FIG. 8 is a schematic representation of a further embodiment of the present 
invention; and 

[0018] FIG. 9 is a schematic illustration of the interior of one embodiment of the light of 
the present invention. 

DETAILED DESCRIPTION OF THE DRAWINGS 

[0019] With reference to FIG. 1, a room light 100 is suspended using a movable support 
system 102. The room light 100 has light projection areas 104. Even though two light 
projection areas 104 are shown in FIG. 1, it is possible for some embodiments that a single 
light projection area 104 can be used while in other embodiments three or more light 
projection areas 104 will be used. The exact number of light projection areas 104 will 
depend on the amount of light needed and also the complexity of the data to be projected. 
The light projection areas 104 are capable of projecting both illumination light and data light. 
In one embodiment, the light projection areas 104 can be any type of system that is capable of 
projection both ambient light and also data light at the same time. These systems include but 
are not limited to liquid crystal display projection systems (LCDP), such as those disclosed in 
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U. S. Patent No. 6,693,691, the disclosure of which is hereby incorporated by reference, and 
digital light projection systems (DLP), such as those disclosed in U. S. Patent No. 5,658,063, 
the disclosure of which is hereby incorporated by reference. Both these systems are well 
known to those of skill in the technology of data and light projection. In other embodiments, 
the illumination light and the data light will be projected from different specialized light 
projection areas 104. 

[0020] Depending on the technology used, each light projection area 104 can be made up 
of a series of light projection areas arranged in a matrix or can be a single lens that can 
project both the illumination light and the data light. In a surgical environment, the combined 
light projection areas 104 should project sufficient light to adequately illuminate the field of 
interest. In order to be sufficiently visible, the data light must be brighter than the 
illumination light. Light 106 is projected from the light projection areas 104 onto a patient 
108. Typically the light 106 is projected onto the skin 110, bone or tissue of the patient 108. 
Because the relationship between the light projection areas and patient is not known and the 
currently visible surface of the patient is not flat, it will be necessary to calibrate the light 
106. This can be done using conventional photogrammetry techniques well known to those 
in the art or by any other means of capturing the projection surface as surface extraction from 
3D scanning, laser range scanning, etc and implicit or explicit registration techniques. One 
such technique involves the use of patterns of light and dark areas that can be placed in the 
field of interest. Based on the projection surface information, the projected light can be 
modified so that the display on the patient 108 appears clear and undistorted. 

[0021] FIG. 9 shows a schematic illustration of the internal structure of one embodiment 
of the room light 100. The room light 100 can include a power supply 600, memory 602, and 
computing devices 604. The memory 602 can be either random access memory or an 
EPROM such that the code stored within the memory 602 can be updated. The room light 
100 may also include drivers 606 for the light projection areas 104. The drivers 606 can be 
either separate devices or can be software or firmware code included within the computing 
device 604 or the memory 602. Hardware, software, or a combination of hardware and 
software can control the various aspects of the room light 100. 
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[0022] The room light 100 is connected to a personal computer 1 12 that has an associated 
display 114. The connection between the room light 100 and the personal computer 1 12 can 
be either a direct connection or a connection through a network or similar architecture such as 
an IEEE 1394 interface. In one embodiment, the personal computer is also connected to a 
navigation camera system 116. The navigation camera system has two CCD camera arrays 
118, and 120, capable of detecting light either reflected or emitted from position sensors 124 
on a tracking device 126. It may be desirable to incorporate more than two CCD camera 
arrays into the light 100 so that the minimum number of arrays will be able to maintain a line 
of sight to the tracking devices 126 at all times. The operation of these camera array 
navigation systems is well known and will not be described further. The light 100 may also 
include a video camera 122 capable of video optical scanning. One such system is disclosed 
in Augmented Reality in the Operating Theatre of the Future, Proceedings of the 4th 
International Conference on Medical Image Computing and Computer- Assisted Intervention 
(MICCAI) Spring 2001, Pages 1 195-1 196, the disclosure of which is incorporated by 
reference. Further a variety of well-known position- sensing devices 124 can be used as the 
position sensors 124. These include both active and passive or reflective optical sensors, 
magnetic sensors, sonic sensors or projectors, inertial sensors or combination systems. 
Multiple tracking devices 126 are typically used during a surgical procedure. These tracking 
devices can be attached or associated with the anatomy of the patient 108 or associated or 
integrated into tools or instruments 128 to be used during the procedure. 

[0023] FIG. 2 shows a further embodiment of the present invention. An operating room 
light 200 is suspended in position using a support system 202. The operating room light 200 
includes light projection areas 204. These are similar to the light projection areas 104 
described relative to FIG. 1 . The operating room light 200 includes integrated locating 
cameras 206. FIG. 2 shows four locating cameras 206 spaced around the operating room 
light 200. Typically for optical systems, two cameras 206 are needed to determine the 
position of tracking devices 126 and instruments 128 with associated tracking devices 126. 
The use of added locating cameras 206 enables a sufficient number of localizing cameras 206 
to be able to see the tracking devices 126 during a procedure without the need to readjust the 
operating room light 200. The operating room light 200 is connected to the personal 
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computer 1 12 that has the associated display 1 14 in a manner similar to that described above 
either directly or through a network. In addition, a video camera 208 similar to that described 
above can also be incorporated in the operating room light 200. 

[0024] The personal computer 1 12 can be any standard personal computer capable of 
using any of the operating systems available commercially. This includes Microsoft 
Windows, Apple OS and UNIX and similar operating systems. The computer 1 12 will have 
loaded software and drivers to enable the light projection areas 104 and 204 to both project 
sufficient light to illuminate the field of interest, such as a surgical field, and to display data 
light onto that same field of interest. The personal computer 1 12 will interact with the 
firmware and/or software within the room light 100 or the operating room light 200. 

[0025] FIG. 3 shows a flow diagram of an embodiment of a method of the present 
invention. The method begins at a block 250 that instructs the system to switch on the light 
areas. A block 252 then enables the light to be positioned so that it projects sufficient light 
onto the field of interest. The order of the blocks 250 and 252 can be reversed and depending 
on the system used for the light, the block 252 can reposition the light elements during any 
procedure if needed. A block 254 acquires the data that is to be projected. The data can be 
acquired from a variety of sources including the navigation system, either one located internal 
to the operating room light 200 or external to the operating room light 200, external 
monitoring devices (not shown), the personal computer 112, other devices connected to the 
network, or any other source of data. The data acquired by the block 254 is passed to the 
system and instructs a block 256 to project data light elements along with the illumination 
light elements. Control then passes to a block 258 that determines if the projected data needs 
to be updated. If an update is needed control passes back to the block 254 that acquires the 
data and the loop continues to the block 256 to display the updated data. The sequence of the 
blocks 258, 254 and 256 will continue until the block 258 determines that the routine or 
process should be terminated. In this case, control passes to the exit 260. 

[0026] FIG. 4 illustrates how the data can be projected to a field of interest, in this case a 
surgical field 300. A surgical drape 302 covers a portion of the surgical field 300 and has an 
opening 304 to permit the surgical team to view a surgical site 305. Using the embodiment of 
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FIG. 2, the operating room light 200 projects a line 306 onto the patient 108 within the 
surgical field 300. The line 306 indicates to the surgical team where to make the planned 
incision within the surgical site 305. A pointing device 308 or other device having a tracker 
310 that is visible to the localizing cameras 206 is placed within the surgical field 300. The 
operating room light 200 projects an arrow 312 that indicates to the surgeon the direction the 
pointer 308 should be moved so that the pointer 308 is on a proper trajectory 314 as planned 
during the surgical pre-planning process. The preplanning process is part of the conventional 
use of surgical navigation systems and typically includes a pre-surgical scan using scanning 
technology such as a CT or an MRI scan. The surgeon will plan the surgical approach using 
the information obtained from these scans and this information is typically loaded into the 
personal computer 1 12 prior to beginning the surgical procedure. Alternatively, it is possible 
to develop this information intra-operatively using known procedures. 

[0027] The operating room light may also be capable in various embodiments of 
projecting one or more of the following data elements either onto the surgical drape 302 
surrounding the surgical site 305 or directly onto the surgical site 305 itself. Data view 316 
shows the same view of the pointer 308 as displayed on the computer display 1 14. Data view 
318 illustrates that a workflow checklist with various instructions to the team can also be 
projected. Alternatively, the data view 318 can include information that is updated or 
modified based on the presence, absence or position or a particular instrument within the 
surgical field 300. Data view 320 is a view of the anatomical structure to guide the surgeon 
to the proper positioning of the patient. Data view 322 shows a variety of vital signs that 
need to be monitored. These can be projected directly onto the field or the surrounding area 
to enable the surgical team to monitor the patient's vital signs without having to turn away to 
a separate monitor or display device. As indicated above, one or more of these data views 
can be projected In one embodiment, the surgical drape 302 can include reflective surfaces 
324 to enhance the display of the projected light. 

[0028] In a further embodiment, as the surgical site 305 is modified during the procedure 
by incisions, retractions, or other aspects of the surgical procedure, the system will self 
calibrate to enable the system to modify the data light projected so that the images are clear 
and undistorted. 
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[0029] FIG. 5 is a further embodiment of the present invention. An operating room light 
400 has a support system 402 that has a series of motorized joints 404. The motorized joints 
404 enable the support system 402 to position the operating room light 400 without the 
surgeon having to manually manipulate the operating room light 400. Furthermore, the 
motorized joints 404 enable a self-calibration process and the ability to automatically adjust 
the operating room light 400 to the best line of sight positions so that the operating room light 
400 is in a position where the light rays shine perpendicularly (in average) on the patient's 
surface. The operating room light 400 has light projection areas 406, localizing cameras 408, 
and video cameras 409 similar to those described with reference to FIG. 2. Cameras 408 and 
409 can be used for localization tasks and/or to assist the acquisition of surface scan data with 
photogrammetry techniques as described above. The operating room light 400 is also 
connected to the computer having the display in the same manner as above. The operating 
room light 400 may also include a tracking device 410 that can be tracked by an external 
tracking system 412 that is similar to the internal tracking system described previously. The 
combination of the motorized joints 404 and the external tracking system 412 can enable the 
system to automatically adjust the operating room light 400 to maintain the optimum 
projection angles for data projection. 

[0030] FIGS. 6a-e illustrate another embodiment of a data light 450 projected onto the 
patient. In FIGS. 6a-e, a planned trajectory 452 and a planned target point 454 are shown. 
An instrument 456 is moved toward an incision point 458 in FIG. 6a. Because the instrument 
is pointing at the incision point 458 that was located during the preplanning process or 
otherwise, but the trajectory of the instrument 456 does not match the planned trajectory, a 
line 460 is projected from the incision point 458. The direction and length of the line 460 
indicates to the surgeon the direction to move the instrument 456. When the instrument 456 
is at the proper point and on the proper trajectory as illustrated in FIG. 6b, the line disappears 
and is replaced by a circle of light 462 having an outer ring 464. The outer ring 464 can be 
distinguished from the circle of light 462 in any manner such as by a difference in brightness 
or color. As shown in FIG. 6c, as the instrument 456 penetrates on the trajectory 452 toward 
the target point 454, the outer ring 464 moves toward the incision point 458. The outer ring 
464 is moved toward the incision point 458 as the instrument proceeds toward the target point 
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452, the circle of light 462 changes character, either by brightness change, color change or 
some other change to indicate that the instrument 456 is at the proper depth as shown in FIG. 
6d. If the instrument 456 pass by the target point 454 as shown in FIG. 6e, the circle of light 
changes to yet a different character to warn that the instrument 456 has passed the target point 
454. 

[0031] FIGS 7a-e show views of light projected onto a simulated skin surface 500. FIGS 
7a-e correspond with the diagrammatic views of FIGS. 6a-e. In FIG 7a, an instrument 502 is 
shown at an incision point 504. A line 506 indicates the direction and amount of adjustment 
of the trajectory of the instrument 502 necessary to place the instrument 502 on the planned 
trajectory line 452. FIG 7b shows a circle of light 508 having an outer ring 510 as the 
instrument 502 is at the incision point 504 and on the proper trajectory 452. FIG. 7c shows 
the movement of the outer ring 510 toward the incision point 504 as the instrument 502 
penetrates toward the target point 454. FIG. 7d shows the circle of light 508 with the change 
of character as the instrument 502 has reached the target point 454. FIG. 7e shows the 
change of character of the circle of light 508 as the instrument 502 passes by the target point 
454. Other combinations of light that can perform the same functions as described above can 
be used. 

[0032] It is also possible to project a three dimensional image using polarized or colored 
lights using conventional three dimensional projection methodologies. FIG. 8 illustrates how 
a user 550 will see a three dimensional projection 552 and 552a of an image 554 of the letter 
"X" onto a surface 556 from a light source 558. The image 554 will appear to the user 550 as 
if the image 554 was at the target point 560. 

[0033] Numerous modifications to the present invention will be apparent to those skilled 
in the art in view of the foregoing description. Accordingly, this description is to be 
construed as illustrative only and is presented for the purpose of enabling those skilled in the 
art to make and use the invention and to teach the best mode of carrying out same. The 
exclusive rights to all modifications that come within the scope of the appended claims are 
reserved. 



